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Abstract: The XENON100 experiment, in operation at the Laboratori Nazionali del Gran Sasso 
(LNGS) in Italy, was designed to search for evidence of dark matter interactions inside a volume 
of liquid xenon using a dual-phase time projection chamber. This paper describes the Slow Con- 
trol System (SCS) of the experiment with emphasis on the distributed architecture as well as on 
its modular and expandable nature. The system software was designed according to the rules of 
Object-Oriented Programming and coded in Java, thus promoting code reusability and maximum 
flexibility during commissioning of the experiment. The SCS has been continuously monitoring 
the XENON100 detector since mid 2008, remotely recording hundreds of parameters on a few 
dozen instruments in real time, and setting emergency alarms for the most important variables. 

Keywords: Slow Control Systems; Particle Physics; Distributed Systems; Dark Matter; Direct 
Detection; LNGS. 
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1. Introduction 

XENON100 is a three-dimensional position-sensitive dual-phase (liquid/gas) time projection cham- 
ber (TPC) flU] filled with ultra-pure liquid xenon to perform a low background dark matter search. 
The detector is installed underground at Laboratori Nazionali del Gran Sasso (LNGS) in Italy. 
Particle interactions in the sensitive volume are detected by two arrays of photomultiplier tubes 
which detect both primary scintillation and ionization signals. These signals are used to perform 
position reconstruction in the TPC, to define a fiducial volume allowing for a drastic reduction of 
the background rate. Nuclear recoils of particles such as neutrons or dark matter WIMPs (weakly 
interacting massive particle) have a higher ionization density than electronic recoils of y and j8 
backgrounds, an effect which can be used to discriminate signal against background OtEltED- Re- 
sults from 225 live days of data of XENON 100 show no evidence for dark matter and new limits are 
imposed for weakly WIMP nucleon scattering cross sections 0]. These results make XENON100 
one of the best detectors currently operational for direct dark matter search. 

As particle physics detectors such as this have become increasingly more complex and de- 
manding, special attention has been given to monitor the dozens of system variables in order to 
guarantee detector integrity and stability. These systems are generically termed "Slow Control 
Systems" (SCS) and are responsible for the constant verification of variables such as pressure, tem- 
perature, high voltages, flow or concentrations, among others, at sampling rates below the Hz range. 
The main purpose of a SCS in a physics experiment can be divided in two main tasks; the monitor- 
ing and control of the conditions potentially able to influence and cause deviations on physics data 
signals, and the safety management of the most delicate parts of the experimental setup. In both 
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cases, a prompt control operation is required if SCS data deviate from the predefined ranges, either 
with an automatic procedure or through an operator driven action. This is a particular sensitive 
aspect for XENON 100 since the detector is operated at pressures of ^2.23 atm and at cryogenic 
conditions (around 181.5 K). Temperature and pressure stability are crucial for the operation of a 
double phase TPC. This most critical aspect of detector operation is temperature regulated by a 
PID-controller (Lakeshore 340 [0]) with UPS backup flU]. This closed-loop control is monitored 
by the SCS through a serial RS232 interface. Indeed, control loops of SCS are kept within the 
instruments level (i.e. temperature controller or flow controller in the purification circuit) and not 
directly by the server itself. Finally, one should emphasize the important role of the SCS on the 
continuous data trend analysis as a proactive tool towards a regular detector operation [0. 

There were two main constraints involved in the design and construction of the SCS that are 
related to the diversity of the multi-institutional XENON 100 collaboration. The first one refers to 
the multitude of equipment, and its different interfaces, brought in by the participant institutions. 
The interface problem was reduced by the use of standard communication protocols available on 
the instruments. The second constraint is related to the heterogeneity of the software operating 
systems of the research teams. This is bypassed using cross-platform frameworks, like the Java 
Virtual Machine environment. Adding more instruments, with standard interfaces to monitor more 
physical parameters, can be accomplished within the frame of a single server machine, with limited 
effort and cost on the overall software design. However, the presented system if not tailored to be 
fully scalable in case the sensors/instruments channels is greatly increased, beyond the single server 
expansion abilities, and a different approach to the whole system would be required. 

The SCS monitors a wide array of detector parameters, such as TPC pressure, temperatures, 
liquid xenon levels, cryostat insulation vacuum, TPC high voltages, as well as photomultiplier high 
voltages and currents. It measures gas flow and pressures in the gas purification system and in the 
gas storage system. In addition, the SCS monitors environmental parameters and auxiliary systems, 
such as the Radon gas concentration inside and outside the detector's radiation shield, additional 
temperatures during the detector preparation, the status of the He compressor (used for the pulse 
tube refrigerator cooling) and the acquisition rates from the DAQ system. 

The following sections describe the SCS architecture (section @) along with the software struc- 
ture of the complete distributed system (section [3|). Experimental parameters read out by the system 
are presented (section |J) and example results from detector stability studies are briefly presented 
and discussed (section |3|). 

2. Hardware Architecture 

The SCS is based on a client-server architecture on a distributed platform with different generic 
client roles ED. The server is located at the LNGS underground facilities, near the XENON 100 
detector, and is responsible for the readout and storage of all data (slow variables) from the in- 
struments and sensors. The need of local operation is only required in an emergency situation, 
when the operation mode is changed or in case of a maintenance intervention on the sensors and 
instruments. Run conditions are quite stable and required intervention on the server side is usually 
minimal. Client programs are distributed worldwide with the purpose of constantly checking for 
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alarm situations and providing a graphical output of the slow variables' progression, as presented 
in more detail in section 0. 

The core of the SCS hardware is the server, which was implemented on a commercial personal 
computer platform under GENTOO Linux [0]. The majority of the instruments and sensors used in 
XENON100 use the serial interface associated to the RS232 protocol. Since the server originally 
had only one native serial port available, two additional 8-channel RS232 expansion cards (Lava 
Octopus 550 [0]) were installed, thus increasing the number of available ports to 17. Since a 
single instrument can have more than one parameter monitored, the XENON 100 set of instruments 
actually represents 801 different parameters. 
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Figure 1. The Slow Control System hardware architecture. Instruments and sensors interface the detector to 
the SCS server. 



In addition to the direct serial interfaces the SCS reads analog signals through an ADC (Su- 
perlogics 8017 flED) with an RS485-to-RS232 bridge, as well as an N2 flow meter (Voegtlin red-y 
0) with a USB interface, and an HV supply crate (CAEN SY1527LC flU) used for the 242 
photomultiplier tubes (PMTs) with an Ethernet interface. Figure [T] illustrates the physical structure 
and connections between the SC server and the sensors and instruments. 



3. Software Architecture 

The SCS software components are implemented in the object-oriented language Java IfPl. The 
advantage of using Java consists mostly on the independence from the hardware platform where it 
is supposed to run. Java ensures that the SCS compatibility is maximized over all the used platforms 
in the experiment, significantly reducing time and effort on the version management for different 
operating systems. 

The SCS software structure consists of 4 components. A server runs on a computer close to the 
detector and locally records the physical parameters making them available to the remote clients. 
A graphical client program that can run on any machine connected to the internet is used for real 
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time visualization, local recording, and customized local alarms. Two alarm clients continuously 
monitor the physical parameters read by the SC server. They issue periodic status reports via email 
and, in case a parameter is outside a pre-defined range, issue alarm messages via email and SMS. 
An alarm monitor continuously checks the network connection between the alarm clients and the 
server through a round-trip command. This combination of redundant components guarantees a 
notification in case of a network problem IfRlllPl. Figure @ depicts the entire SC distributed 
system for the XENON 100 experiment. 




ENON100 
Detector 



Figure 2. The Slow Control System distributed structure. The SC server is located at the experiment site 
(LNGS) and SC data is recorded at the server and periodically synchronized at the Backup DataCenter 



3.1 Server 

Each instrument read by the SCS can include one or more channels. The measurements for a 
specific channel are time-stamped and continuously written in log buffers, first in memory and 
afterwards to a master log in a tree file structure. The instruments are repeatedly polled by the 
server, as they are triggered by a dedicated timer (instrument specific thread) each with a config- 
urable period. This results in a set of independent timer threads continuously running and logging 
channel measurements. If one of the instruments fails to respond to a polling request, the overall 
multithreaded server program is not compromised for the other instruments. 

These measurements are also stored locally in a MySQL database and mirrored to a Backup 
DataCenter to avoid data loss. This allows direct queries for a particular instrument measurement 
range during data analysis without introducing latencies due to database queries over the server. 

The memory buffered data on the Server can also be accessed by the Client and Alarm Client 
programs through the Java Remote Method Interface (RMI). The measurement data on the Server 
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is periodically logged to list files and progressively removed from the local memory after a user 
defined persistence time, to ensure that the memory space is never overloaded. 



3.2 Client 

The SC Client application connects to the Server to retrieve the list of channels being monitored 
and to start timers that will periodically retrieve selected measurements from the Server. Once the 
list of channels is available, the client is able to register and to display the measurements from each 
channel. Near real-time channels data is plotted in configurable graphical panels. Independent 
local alarms can be set on the client but in this case only the local user is warned through a sound 
message. Figure [3] depicts the main window of SC Client. 
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Figure 3. Main window of the SCS client showing some of the most relevant parameters and local alarms 
settings window. 

False alarms due to data glitches are avoided by using a grace count (i.e. the tolerated number 
of data points outside the allowed range) chosen independently for each parameter. The Client is 
also capable of saving data as plots or in text format, allowing to quickly reference data. 

Due to the large number of 242 PMTs used in XENON 100, plotting is an inefficient way to 
present the data of these channels. Instead, a table with the set-points and monitored values is 
given, allowing quick access to the status of a particular PMT. 
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3.3 Alarms 

The Alarm Client programs periodically check the values of a pre-defined set of channels chosen 
by local configuration files. The update period depends on the parameter itself and ranges from 
a few seconds to around one minute. Alarm events are triggered either if at least one parameter 
value falls outside the allowed range, if a channel is not updated, or if the connection to the server 
cannot be established anymore. In either case an alarm state is reached and an email and/or SMS 
is issued (through an SMS web gateway). Additionally, these programs issue a periodic status 
report to keep track of the latest values of the most critical parameters for the detector operation 
such as, e.g., the pressure inside the TPC, temperatures, or the gas purification flow. The alarm 
configuration (channels to be monitored, emails, phone numbers) are defined locally and alarm 
clients run independently at two distinct locations to increase redundancy and fault tolerance of the 
overall system in the case of a network communications failure IfTSll. The alarms can also be run 
locally, in which case there's the limitation of absent notification from this alarm client in case of a 
network failure at LNGS. To avoid such condition, the alarms also cross monitor one another and 
distribute alarm messages if a network problem or latency is observed (Figure 0) 

4. Experimental Parameters 

The purpose of the XENON 100 Slow Control System is to continuously give a clear picture of the 
detector status and operation and to allow the user to correlate the science data with the detector 
operating conditions during data taking. In the case of XENON100, which employs a liquid xenon 
TPC flU], the key parameters that need to be monitored are those that ensure the detector integrity 
and the quality of operation, namely: 

• Xenon Gas Pressure - The pressure of the xenon gas in the system is of crucial importance, 
both for operation and safety. The pressure is monitored inside the detector chamber and in 
the storage system that collects the xenon during detector maintenance. These are monitored 
by GT1600 sensors from Stellar Technologies IfTTIl. digitized by a 16 bit, 8 channel, Super- 
logics 8017A ADC IfTOl. Additionally, there is a physical connection, for the pressure inside 
the detector, to the underground laboratory system which triggers an alarm for immediate 
action. This connection also automatically opens a cryogenic solenoid valve to a filled LN2 
dewar for emergency cooling of the xenon. 

• Temperatures - The temperature of the detector is monitored at six locations by calibrated 
PtlOO sensors. Two of them are located on the Pulse Tube Refrigerator (PTR) providing 
the power to cool and liquefy the xenon IfTEll. The other four are located at various heights 
inside the detector (in the liquid xenon and in the gas). All are read by a temperature con- 
troller (Lakeshore 340 [0]), which communicates its readings to the SC server via an RS232 
interface. During detector preparation, an additional set of PtlOO sensors is used to monitor 
baking temperatures at various external locations on the detector. 

• High Voltage Supply - The high voltage for the detector is provided by two devices. A 
CAEN SY1527LC mainframe supplies the voltages for the anode and all the 242 PMTs, 
through an Ethernet interface. This device is periodically polled by the SC server that is 
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able to set and read voltages, monitor tripping conditions, raise HV levels without user inter- 
vention, store time stamps in the database, and issue alarms if a procedure is not successful 
after a configurable number of attempts. The HV mainframe interface is made through a 
set of functions in an HV Wrapper C/C++ library supplied by CAEN lOl. The cathode is 
biased by a high precision Heinzinger PNC 1 00000-3 -neg power supply IfTPIl and is also read 
through an ADC channel IfTOl. 

• Flowmeters - The xenon flow rate is monitored in both the recirculation and recuperation cir- 
cuits by a mass flow controller (Teledyne Instruments, THPS100) with an RS-232 interface 

• Levelmeters - The xenon level inside the TPC is measured by custom made capacitive sen- 
sors both for full-range and fine level assessment at the liquid xenon surface region. Three 
fine levelmeters and a 4 th reference levelmeter, are axially distributed around the TPC axis 
and, in this way, allow for precise alignment and tilt correction. Readout from these level- 
meters is performed through UTI03 chips, from Smartec lEHIl. which interface the SCS over 
the RS232 protocol. 

• DAQ Rate - The SC monitors the average DAQ rate over a local NFS mapped file. The SCS 
timestamps are correlated to the DAQ system by using the same time server. 



Other parameters included in the SCS are summarized in table 1. 



Parameter 


Instrument 


Supplier 


Interface 


Cryostat Vacuum Pressure 1 12211 


D35614 


Pfeifer Vacuum 


RS232 


Shield LN 2 Purge Flow flO 


Red-y smart series 


Voegtlin Intruments 


Modbus over USB 


Radon Concentration Q (2x) 


Rad-7 


Durridge Inc 


RS232 


Atmospheric pressure IE311 


144SU005A 


SensorTechnics 


Analog to ADC 


Helium Compressor 112511 


PT407-CP2880 


Cryomech Inc. 


RS232 



Table 1. Other instruments and sensors monitored in the XENON 100 experiment 



5. Results and Future Work 

Data provided by the SCS is promptly accessible through the database or the list files. It is analyzed 
and cross-correlated with other experimental data to emphasize a particular aspect of the detector 
operation like the search for trends or deviations from set points. Shifters on-site and scientists 
abroad can easily follow the LNGS operations online without latency. As an example, the plots for 
the absolute xenon gas pressure and temperature of the LXe inside the TPC are depicted in Figure |], 
evidencing a remarkable stability (better than ±0.6% for the absolute pressure and ±0.15% for the 
temperature) for nearly 13 months of data taking that resulted in the dark matter results presented 
in U. 
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Figure 4. Absolute pressure (top) and temperature (bottom) inside the XENON 100 TPC acquired during 
13 months of continuous data taking for the results presented in 0]. The parameters are stable well below 
±0.6% and ±0.15% for the absolute pressure and the temperature, respectively, as indicated by the hori- 
zontal lines. All sudden changes of the numbers are related to instrument maintenance and these periods 
are not used for data analysis. When smaller time scales are considered, the detector stability is even more 
remarkable 



Global short term trends can be spotted by a quick observation of this kind of data. Long term 
stability is also easily monitored by querying the database over the desired time period. Besides 
maintenance and upgrades, this system has been continuously and steadily running since the ex- 
periment's commissioning in early 2008. Future work tasks for the SCS of XENON100 include 
the integration of additional instrumentation used on the krypton removal column (used to achieve 
ultra pure xenon), the improvement of the configuration management, and the creation of a higher 
control layer able to show the status of each component of the SCS in real-time. 

The experience resulting from the development, operation, and maintenance of the XENON 100 
SCS enters ongoing development of a slow control system for the next experiment XENON1T. 



6. Conclusions 

The Slow Control System (SCS) for the XENON 100 direct dark matter search experiment was 
presented and discussed. The system instrumentation is based on industrial and customized hard- 
ware while the software layer was designed using the object-oriented paradigm and coded in Java 
for platform independence. A timer-thread driven approach enables the readout of a large number 
of instruments without compromising the overall performance and increases the fault tolerance in 
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case of an instrument failure. The distributed architecture greatly improves redundancy and allows 
remote monitoring of the detector. The combination of these two features allows for continuous 
monitoring and safe operation of the XENON 100 detector. 
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